An expression for stationary distribution in nonequilibrium steady state 
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We study the nonequilibrium steady state realized in a general stochastic system attached to 
multiple heat baths and/or driven by an external force. Starting from the detailed fluctuation 
theorem we derive concise and suggestive expressions for the corresponding stationary distribution 
which are correct up to the second order in thermodynamic forces. The probability of a microstate r] 
is proportional to exp["I>(r;)] where '^(rf) — — '^f, j3i^Sk(rf) is the excess entropy change. Here Sk{rj) is 
the difference between two kinds of conditioned path ensemble averages of excess heat transfer from 
the fc-th heat bath whose inverse temperature is Pk- Our expression may be verified experimentally 
in nonequilibrium states realized, for example, in mesoscopic systems. 



PACS numbers: 05.70.Ln,05.40.-a 

A challenge in theoretical physics is to find an ex- 
tension of the Boltzmann factor e^^^ which works in 
nonequilibrium systems. The present work reports a 
promising result which definitely goes beyond the linear 
response theory. 

To be precise our concern here is to obtain concise and 
accurate characterization of the stationary distribution 
associated with the nonequilibrium steady state (NESS) 
in a system with heat currents and/or under external 
drive. If the system is indefinitely close to equilibrium, 
there is a compact expression for the NESS in terms of 
fiuctuation of nonequilibrium currents (or entropy pro- 
duction) as is known in the linear response theory [1,] . As 
for a general system far from equilibrium, exact but for- 
mal expressions (like (0) below) for the NESS have been 
known and used as startingpoints of further studies of 
nonequilibrium physics 0, U 01 ■ As we shall discuss, 
however, such formal expressions as they are turn out to 
be far from useful or enlightening. 

In the present Letter, we start from the detailed fiuc- 
tuation theorem 0, 0, 0, d, and derive a novel 
general expression ([TB)) for the NESS, which is correct 
up to the second order in thermodynamic forces. The 
expression, which involves expectation values of excess 
entropy change in transient regimes, is neat and quite 
suggestive. Since the expression can be rewritten as p7)) 
using (excess) heat transfers, it may be verified in actual 
experiments. 

We hope that the novel expression leads to a better 
understanding of general features of NESS, and can be 
an important step in the construction of future nonequi- 
librium statistical mechanics. 

We consider a classical system attached to multiple 
heat baths and driven by an external force. We assume 
that the system has a well defined energy H(ri), where 
r] denotes the microscopic state. The change of H{r]) 
in any process is identical to the sum of the total heat 



transfer into the system from the heat baths and the 
total work done by the external force. We further assume 
H{ri) = H{r]*), where rj* is the time reversal of 7y, i.e., the 
state obtained by reversing the signs of all the momenta 
in 77. 

For simplicity, we here treat a stochastic process with 
discretized state space and time. Extensions to contin- 
uum case are straightforward. By rjt we denote the (mi- 
croscopic) state of the system at time t. A path or a 
microscopic history is denoted as — (770, rj^t, ■ ■ ■ , ?7t), 
where At is the unit of time. We mainly consider paths 
from t — to t = T and sometimes use simpler no- 

Time-reversal operation {) is 
,770). The path prob- 



tation r instead of 







-At' 



defined as t^F, 
ability P{Tq) that a path FJ is realized is written as 
P{Tq) = pini{r]o)T{rQ) where pini is the initial distribu- 
tion and T is the transition probability associated with 
the history FJ. 

It has been established that, in a wide class of systems, 
the transition probabilities of a path F and its time re- 
versed path liT satisfies the relation 



r(F)/r(79F) = e^(r). 



(la) 



with the total entropy production along F defined as 

S{r):=-(3-Q{r)^-J2f3kQk{T), (lb) 

k 

where Qfc(F) is the total heat transfer from the k-th heat 
bath (whose inverse temperature is f3k) to the system dur- 
ing the history F. Here we have written /3 = (/3i, /32, ■ • ' ) 
and Q — {Qi,Q2, ■ ■ •)■ The relation ((T]) can be derived 
for Langevin models from the Onsager-Machlup path in- 
tegrals jul, and also for Hamiltonian systems [10|. It is 
sometimes called the detailed fiuctuation theorem [l3| . 

In the present work we study the NESS maintained 
by heat currents and/or a static external force /cxt in a 



2 



general system satisfying the symmetry ([T]). By taking as 
a reference the equihbrium state where all the heat baths 
have the same inverse temperature P"^^ and /cxt = 0, a 
NESS is specified by the thermodynamic forces 



(2) 



By our assumption, the change of the energy during F, 
H{T]r) - H{r]o), is equal to EfcQfc(r) + WiT), where 
VF(r) is the external work done to the system during T. 
We assume W is written as W = /oxt • Rc, where Rc is 
displacement conjugate to /ext- 

In the following, path dependent observables are de- 
noted as X{Tq), X{T), or X. Path ensemble average of 
X is denoted by {Xj := ^pX(r)P(r). We define the 
"conditioned path ensemble average" (CPEA) as 

iX)U^, :=((<5,,,,X))/(<5,,,,)), (3) 

where the subscript "r/t = ?/" specifies the condition. 

Let T(r; e) denote the transition probability under the 
thermodynamic forces e. We consider path probabilities 



pcq(r5) 

pcs(rr) 



= Pst(»7o)T(r5;e), 
= Pca„(?7o)r(r5;0), 
= Pcan(?7o)'7'(r5;e), 



(4) 



where Pstiv) is the stationary distribution in the NESS 
and Pcan('7) := exp{—P^'iH{ri))/Z{(3'^'i) is the canonical 
distribution at the equilibrium. The path ensemble av- 
erages defined by P^*- , P"'^ and P^'^ are denoted as {f^ , 
(•))°'' and {f^^ , respectively. Similarly, the CPEAs defined 
with P*^*, P<='i and P°" are denoted by {)%%^, {fr^^r, and 



Eq. (|la|) and the third equation in ^ lead to 

p°^(r)/p'=''(i?r) = e^'(^\ 

where Si is defined as 

^i(r) := s{r) + p-^[H{Tjr)-H{m)] 



(5) 



(6) 



Here we set A/3 := (/3i - /^^'i, P2 - P"'^, • • ■ ) and use VF = 
HiVr) — H{r]Q) — J2k Qk- Using thermodynamic forces e, 
the quantity Si is written with R :— (Q, R^) as 

5i(r) - e ■ R{r), (7) 

which implies that 6*1 is 0(|e|) and 5*1 = at the equilib- 
rium. 

Using Eqs. Q and the symmetry S'i(r) = -Si{-dr), 
we obtain the relation 



(8) 



By letting X — (5,,^,,, in Eq. ^ we get a well-known 
formal expression 



Pr(^)=Pcan(r?*)((e-^^(^)))-^,., 



(9) 



where Priv) is the distribution at time t evolved un- 
der the thermodynamic forces e from the initial canoni- 
cal distribution. For sufficiently large r, the distribution 
Pt{vi) should converge to the stationary distribution in 
the NESS, Pstiv)- To obtain Eq. we used the trivial 
relations pr{ri) = ' and Pcan(?7*) = iSvo,v'f''- 

The expression (|9]) is an example of exact but for- 
mal expressions of NESS, which have been well-known 
and widely used 0, 0, Although Q is exact, it is 
hardly useful (as it is) because it involves the average 
over the whole (long) history. Moreover since the quan- 
tity S'i(r) typically diverges linearly in time, the quantity 
exp[— S'i(r)] should exhibit wild fluctuation. 

We note in passing that when the system is indefinitely 
close to equilibrium, one may approximate ([9|) as 



Priv) - PcaniV*) SXp 

= Pcaniv*) exp 



-((5i(r 



(10) 



which can be used as a starting point of the linear re- 
sponse theory [l], • 

We shall now derive our expressions (fT6)) . (fT7|) for 
NESS, which are almost as concise as ([T0|) but take 
properly into account nonlinear effects. By letting X = 



-Si/2 



in Eq. 



we obtain 



(11) 



Let us consider the standard cummulant expansion 



Vhjt =») 



'iiSi}';^^^^ 4 



o{\en 



(12) 

where we generally write {A; B) {AB} - {A}(B)). To get 
the second line in (fT2|) we noted that {Sr,Si}^^^^ is al- 
ready a quantity of 0(|ep), and the nonequilibrium cor- 
rection only gives a contribution of 0(|e|'^). Substituting 
Eq. (dH) into Eq. ([TTl), we obtain 



Priv) = Pcan('7)x 



exp 



(13) 



where the contributions from the second cummulants 
in 0(|ep) have canceled out, because {Si; Si}'^'^^^,yM — 
{Si; S'i))°'J^^. This follows from the relation in equilibrium, 

{xir))f^^^^.={xm%Ur 

Considering Eq. (fT^ for sufficiently large t, we can 
further rewrite it into the form with path ensemble aver- 
ages in NESS, while Eq. (|13p is written as that in tran- 
sient processes from equilibrium to NESS. In the limit 
T ^ 00, the two CPEAs in the exponent on the r.h.s. of 
Eq. (fTS]) diverge but these divergences cancel with each 
other because the both CPEAs diverge with the same 
rate ar where a is the entropy production rate in the 
NESS. 
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Substituting Eq. ([6]) into Eq. ([13]) and taking the limit 
of large r, we thus have 



Pst(?7) ocexp i (((% 



exp 



"Vt=V 



J + Oiler, 
+ 0{\e\^) 



where the excess entropy change Sex is defined as 



S 



hm -| 

r — >oo T 



(14) 



(15) 



Here a is the entropy production rate in the NESS. To get 
Eq. ((T4)) . we omitted ry-independent parts, noted that the 
system loses the memory of the initial condition for suf- 
ficiently large r, i.e. hm,^^(ff (r?,)))-^^. = ((i7(?7.)r, 
and used the relation lim^^oo Priv) = Pstiv)- In EQ- P^ - 
the factor Pcan(?7) disappears because (S'l))^^^^^ 
is equal to - + 2(3'"iH{ri) apart from 77- 

independent parts. 

We further divide the contribution of the second term 
of the exponent on the r.h.s. in Eq. (|14p into two parts: 
one is that from equilibrium to steady state, and the 
other is that from the steady to the specified state ry. Be- 
cause both the contributions converge within finite time, 
we decompose ((5ox))^'=^ into (S'ox))^*^ =^ + (5'cx))°'' for suffi- 
ciently large t. We further omit the second term on r.h.s 
which does not depend on rj. From the definitions of the 
CPEAs, we have ((^cx))^^,=„. = (^cx))^*=^.. Then Eq. ^ 
leads to a neat expression 



p.t(r;)oce*('')+o(l^l^), 



4>(77) := lim — 

r^oo 2 



'cx)),j^: 



'cx)),jo = 



(16a) 



(16b) 



which is our main result. Note that ^(jy), which plays the 
role of —j3H{irj) in the equilibrium, is the difference be- 
tween the excess entropy changes evaluated in the CPEAs 
which have 77 as the final state and 77* as the initial state, 
(see Fig. m) 

It is quite interesting that such a combination of the 
first moments can give the result which is correct up to 
0(|ep). It is crucial that these excess entropy changes 
depend only on transient regimes near the final or initial 
time. This is in a sharp contrast between the formal 
expression ([H]), which includes the average over the whole 
history. 

It may be convenient, e.g. for actual measurements, 
to rewrite the excess entropy change Sex in terms of heat 
transfer. Using the definition (jlbp . Eq. (|16p can be writ- 
ten as 

p,t(?7)oce*('')+o(l'^l'), $(77) = -^/3feffe(77) (17a) 



£k{ri) ■■= lim - 



Ccx.k// 



(17b) 




St 



FIG. 1: Schematics for two kinds of CPEA. Here 77* is the 
time-reversed microstate of rj. The arrows show path of the 
system. 



where the excess heat transfer Qcx,k is defined as 



i cx,/c 



(18) 



Here is the steady heat flow at NESS, and one has a = 
— (3k ■ Note that Ek{ii) is essentially the difference 
between the excess heat transfers evaluated in the CPEAs 
which have rj as the final state and 77* as the initial state. 
Since the ensemble averages of the excess heat transfer 
are supposed to show good convergence as in [l3| . the 
limit r ^ 00 is expected to be effectively realized for 
moderately large r. 

When the system in the equilibrium state at the in- 
verse temperature (3, we have the relation /3 • £(77) = 
f3J2k£k{v) = P[H{v) - (-ff)"''], where is the mean 

energy of the system at the equilibrium. Thus the Boltz- 
mann factor exp(—/3 7/(77)) iSj of course, included in the 
form of Eqs. ([T7]) as a special case. 

Numerical demonstrations: In order to demonstrate 
performance of our expression, we here show the results 
for a thermally driven ratchet IJ, [lj| where Langevin 
description for the heat baths is adopted. The model 
consists of one translational degree of freedom x and an- 
other degree y. The degrees x and y are coupled to heat 
baths with inverse temperatures (3^ and Py, respectively. 
The system has periodic structure in x and the external 
force / is applied on x. The time evolution of the system 
is described by the set of Langevin equations. 



X = ./2/P^Ut)~dU{x,y)/dx + f, 
y = y^^y(t)~dU{x,y)/dy, 



(19) 



where U{x,y) = exp(— 77 + 0(x)) -|- 7/^/2, (j){x) — 
— sin(27ra;)/2 — sin(47rx)/12 -|- 1/2 and £,*{t) represent 
Gaussian white noises with a variance of unity. For a ref- 
erence of energy scale, the energy barrier of this ratchet 
potential is about 0.81. 

We measured $(77) by observing excess heat transfer 
from each heat bath. In Fig. Ufa), comparison between 
^{"n) = ~/3 • ^iv) and lnpst(?7) is shown for the cases in 
which both temperature difference and external field are 
simultaneously applied to the system. We can see the ex- 
pression works well even when the temperature difference 
is large. As a detection for deviations of the expression 
([TT]) from the true Pstirf), Fig. E^b) shows the differ- 
ences between expectation value of energy averaged with 
Pstiv) E^nd that with exp[$(77)]/Z where Z is a normal- 
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(a) 




(b)10' 




FIG. 2: Verification of the expression (|17|) for the station- 
ary distribution Pst{rj) in NESS, (a) The contours of $(77) — 
—13 ■ £{rf) (circles) and Inpstijf) (solid lines) are plotted for 
{f3x,f3y,f) = (1, 10, 0.8). Eqs. ini) seems to work rather well 
even though Py/Px = 10. Contours are drawn at {0.5,0,-1,- 
2,-3} and most probable states are marked with "H". The 
values of ^{r]) are shifted with some constant values which 
correspond to a normalization constant, (b) Error estimation 
by the difference \A{H)\ ~ H{-n)[pst{v) - eMHv))/Z]\ 
where Z is a normalization constant. Triangles show data set 
varying / with Px ~ I3y = 2. Circles show data set vary- 
ing f3y with Px — 2, f = 0. The drawn guide line is e^. For 
the calculation of pstirj), we numerically solved Focker-Planck 
equations corresponding to the Langevin equations (|19|l . For 
$(?)), we constructed and solved a set of difference equations 
for CPEAs of the excess heat transfer. We have checked these 
results are consistent with results obtained by direct simula- 
tion of Langevin equations with stochastic energetics [T3 |. 



ization constant. From the figure, the error is estimated 
as 0(|e|^). This clearly supports our theoretical result. 

Discussions: It is worth pointing out that in the phe- 
nomenological approach to NESS developed in 15| (See 
also j3| ) , "excess" heat transfers rather than "bare" heat 
transfers play fundamental roles. The fact that our novel 
expressions (IT51) , p7)) are also based on excess heat trans- 
fers is quite suggestive and encouraging. A challeng- 
ing future problem is to investigate characterizations of 
NESS based on Eqs. ^ or e.g. stability of NESS, 
transition between NESSs, the principles of heat transfer 
enhancement previously suggested in [l3|, and so on. 

It is also interesting to confirm the expression Eqs. (fTT)) 
by precisely measuring heat transfers in nonequilibrium 
steady states in real systems. Although such experiments 
need rather high skills to sustain temperature difference 
in a small system and to measure heat transfer with a 
sufficiently high resolution in time, we believe such mea- 
surements are possible, for instance in the mesoscopic low 



temperature system 17[. 



probability. We need more precise information, which 
turns out to be conditioned path ensemble averages of 
the excess heat transfer. One is the average for paths 
reaching ij and the other is that for paths leaving the 
time-reversed microstate rj*. In other words, the proba- 
bility is determined by the difference between the excess 
entropy change until reaching 77 and that after leaving 77* . 
In equilibrium, one-way information is sufficient because 
of the symmetry between the two, but in nonequilibrium 
the combination of the two becomes essential. The ex- 
pression presented here is correct up to the second order 
in thermodynamic force. Higher order corrections can 
be obtained in a straightforward manner. We hope re- 
searches following the present results will open a route to 
new concepts for the structure embedded in NESS. 

We are very grateful to S. Sasa and H. Tasaki for dis- 
cussions and critical readings of this manuscript, and in- 
debted to H. Tasaki for simplifying an earlier version of 
the derivation. 



In summary, the expression presented here is a natu- 
ral extension of the canonical distribution. In NESS, the 
energy of the microstate r/ is not sufficient to specify the 
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